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We derive the extended fluctuation theorems in presence of multiple measurements and feedback, when the 
system is governed by Hamiltonian dynamics. We use only the forward phase space trajectories in the derivation. 
However, to obtain an expression for the efficacy parameter, we must necessarily use the notion of reverse 
trajectory. Our results show that the correction term appearing in the exponent of the extended fluctuation 
theorems are non-unique, whereas the physical meaning of the efficacy parameter is unique. 


I. INTRODUCTION 

The field of nonequilibrium statistical mechanics, al¬ 
though vastly studied, has few exact laws that remain 
valid when the system of interest is far from thermody¬ 
namic equilibrium (i.e., the regime where the linear re¬ 
sponse theory breaks down). The so-called fluctuation 
theorems are one of those rare equalities that have quali¬ 
fied to be in this list |T|-[l5i]. One of them is the celebrated 
Jarzynski equality (JE) J310I, which is relevant when the 
system is initially (at time t = 0) at thermal equilib¬ 
rium with a medium at temperature /3 _1 , and has thereby 
been perturbed by an external time-dependent perturba¬ 
tion A (t) for a time duration r. We take the average of 
the quantity e” ;H (where W is the work done on the 
system) over a large number of experimental realizations 
of the same process. If A F is the net change in Hemholtz 
free energy, which is in turn equal to the work done dur¬ 
ing an isothermal reversible process, then the JE states 
that 

L-m- af)^ = ! (1) 

This, in conjunction with the Jensen’s Inequality leads 
to the statement of the Second Law: (W) > A F. In 
other words, the average work done on the system for 
any process cannot be less than that done during a re¬ 
versible process. 

In recent literature, it has been shown that this equa¬ 
tion as well as the corresponding Second Law inequal¬ 
ity undergoes a change when the external perturbation is 
governed by a feedback mechanism IH6M21I1 . These re¬ 
sults can be readily derived by starting with the ratio be¬ 
tween the forward and time-reversed phase space paths in 
the forward process (with protocol A (t)) and the reverse 
process (with protocol A(r — t)), respectively. Stated 
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differently, the feedback control acts as a Maxwell’s De¬ 
mon that increases the free energy of the system 122}]. 
However, the definition of the reverse process in pres¬ 
ence of feedback is not unique. Depending on whether 
we choose to apply feedback during the reverse process, 
the extended JE takes up different correction terms |23j]. 
But the reverse process is only a mathematical tool to 
prove the integral fluctuation relations, which in turn are 
averages over the forward paths only. This means that in 
an experimental verification of the theorems, we need not 
generate the reverse process at all. The question that one 
might ask is: can the theorems be proven without taking 
help of the reverse paths, using the expressions for the 
forward trajectories only? We show below that this can 
indeed be done for a system whose dynamics is governed 
by the Hamilton’s equations of motion. The Hamilto¬ 
nian approach has been used extensively and success¬ 
fully in deriving the Jarzynski Equality, the Crooks Fluc¬ 
tuation Theorem, measure of dissipation and arrow of 
time. Hamiltonian derivation has also been used in [22] 
for single measurement and feedback. We extend this 
Hamiltonian derivation to the case of multiple measure¬ 
ment and feedback, using only the forward trajectories. 
However, for calculating the efficacy parameter, the ex¬ 
tended FTs require the notion of time-reversed trajecto¬ 
ries, as detailed later. 

II. JARZYNSKI EQUALITY FOR A HAMILTONIAN 
SYSTEM WITH FEEDBACK 

We consider a system that is described by the Hamil¬ 
tonian H(t) = H(q,p;t). A microstate of the system 
is given by a point x = ( q,p) in phase space, whose 
evolution follows Hamiltonian dynamics: 

q{t) = d p H(t), 

p(t) = -d q H(t). (2) 

In the above equations, the overhead dot appearing on 
the LHS represents total derivative with respect to time. 



while the RHS consists of partial derivatives with respect 
to momenta and coordinates, respectively. Under the 
Hamiltonian dynamics, any phase point x t can be writ¬ 
ten in terms of the initial phase point as x t = M t (x o), 
which is a one-to-one mapping (22|]. Similarly, the in¬ 
verse mapping can also be defined as Xq = Mf 1 (x t ). 

The system was initially in a state of thermal equilib¬ 
rium, so that the initial state of the system follows the 
Boltzmann distribution 


outcomes {jy}. The average is over all paths, the proba¬ 
bility of each path being 

p( x o)P y0 [ x o -» x i]piVi\ x i)PyA x i -» * 2 ] 

X • ' • X p(y N \ x N)Py N [ X N -»■ x r\ 

= p( x o)p(yo\ x o)p(yi\ x i) ■ ■ 'p(yN\ x N)P{ yi }{{ x i}\ x o)- 

( 6 ) 


po(qo,Po) 


e -PH( 0) 


(3) 


This condition can be relaxed for arbitrary initial distri¬ 
bution which will be discussed later. 

We now subject this system to the following process 
l20ll : we measure the state of the system at time t = 0 
and obtain an outcome y 0 with the error probability 
p(yo\ x o)- Here, x 0 is the actual initial state of the sys¬ 
tem, which is in general different from the measured out¬ 
come 2/0 due to measurement errors. Next, we apply 
an external protocol X yo (t) from time t = 0 up to time 
t = t\ , when a second measurement is performed. Once 
again, depending on the outcome y \ that is obtained with 
error probability p{yi\x{), the functional form of the 
protocol is changed to A yi (t). Here, the subscript y\ 
implies that the new protocol in general depends on the 
measurement history {yo, yi}- This process is continued 
till time tN when the last measurement is performed. The 
final value of the protocol is X yN (r). 


Ayjv (f) 



FIG. 1. Protocol X(t) for a given set of measurements {yi}. 

We will see that the JE gets modified in the presence 
of feedback. The modified relation is given by 

= L (4) 

Here, I is the mutual information between the actual 
variables {xA and the measured variables {y,}, defined 
through the expression ifnl |20l l 

/({*,}, to.}) = 

(5) 

Here, P({yi}) is the probability of a set of measurement 


This probability includes variables { x r } as well as mea¬ 
sured values {y,}. We assume that the different measure¬ 
ments are independent. P yk [x/ c —> cc/s+i] is the probabil¬ 
ity for going from Xk to Xk+i under the protocol \ yt (t). 
P{yi}(i x i}\ x 0 ) is the probabability of the path {xA un¬ 
der the given protocol {y,:}, with the given initial point 
x o- 

To derive Eq. we first note that in a Hamiltonian 
dynamics, the total work done is equal to the net change 
in the internal energy: H(x t ,t ) — H(x 0 ,0). This fol¬ 
lows from the fact that the net work done is equal to 
the sum of the works done in the intervals between any 
two measurements: W = ]TT Wi = — 

H(xi-i,ti-i)\. For simplicity, from now on we will use 
the notation H{t) = H{x{t ), t). We begin with the def¬ 
inition of the average appearing on the left hand side of 
Eq. © 


,-P{W-AF)-I 



i}{dy l }p(x 0 )P{ yi }({x i }\xo) 


xp(y Q \ x o)p(y 1 \x 1 )---p(y N \ x N)e /3(w ' AF) J . 

(7) 


Using the equilibrium initial distribution, it becomes 

f e -PH( 0 ) 

J {dxi}{dyi} z ^ P {yi} {{ x i}\ x o) 

x p(yo|*o)p(j/i|*i) • • ■ p(yN\ x N)e~ fj{HiT) ~ Hi0)) 

x m x PHuA) (8) 

Z{t) p{yo\ x o)p{yi\ x i)---p{yN\ x N) 

We have used the definition of I and of free energy 
change in terms of the partition function: A F = 
\w[Z(ff)/Z[r)\. Now, we make use of the fact that 
in Hamiltonian dynamics, P{ yi }{{ x i\\ x o) = 3( x i — 

Mff (xq)) 6 (x 2 — Mff(x 0 )) • • ■. This means that once 
the initial point is given, all other phase points on the tra¬ 
jectory are determined and the trajectory is unique. This 
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allows us to write 


(^,-fpW-AF) 



dx 0 {dyi} 

d.x T {d,y,} 


e -PH(r) 

e ~0H(r) 


1 


Z(r) 


Z(t) 

dx T e~ pH ^ T) 


P({Vi}) 

P({Vi}) 

= 1 . ( 9 ) 


In the last line, we have used the fact that the Jacobian 
for transformation of x () to x T is unity: dx o = dx T . 
Thus, we have derived eq. (UJ). However, this is not the 
case if the system is stochastic (the RHS would then be 
replaced by its average). Then in order to obtain Eq. ©, 
one must use the concept of time-reversed phase space 
trajectories, and invoke the Crooks relation for the ratio 
of forward to reverse path probabilities @|. 

An application of Jensen’s inequality to Eq. (0 yields 
the modified second law for feedback-driven systems: 


(W - AF) > -k B T </). (10) 

We note that (I) is a Kullback-Leibler divergence O, 
so the RHS of the above relation is negative. Thus, it 
is in principle possible to beat the traditional second law 
(in which the right hand side of (ITOl is zero) in feedback- 
driven systems. This happens, for instance, in the Szilard 
engine where work can be extracted in a cyclic process 
(by using thermal energy of the heat bath) even though 
there is no change in free energy. Even in the absence 
of feedback, the second law is valid on average, but tran¬ 
sient violations are possible at the level of a single trajec¬ 
tory sis. 

Let us consider the case when the initial condition is 
not thermal equilibrium, but is given by an arbitrary dis¬ 
tribution p{xq). We define the Kullback-Leibler distance 
between the actual distribution (given by the dynamics) 
and the corresponding equilibrium distribution (to which 
the system will relax if the external parameter is frozen 
in time) to be 

D{x,t) = j dxp(x,t) (11) 

Then the change in D(x , t) for a trajectory is given by 
AD = D(x t ,t) — D(x o, 0) ll26ll . Given that the system 
would finally relax to an equilibrium state if the protocol 
is held fixed, one can now readily show that the Jarzynski 
equality generalizes to 


^ e -P(W-AF)+AD^ = 1 

Application of Jensen’s inequality gives 
(W - AF) > AD. 


( 12 ) 


( 13 ) 


This shows that even for a single temperature bath, one 
can extract work, provided the system is prepared ini¬ 
tially in a non-equilibrium state. 

We next show that the correction term (the mutual 
information in the case discussed above) is not unique, 
even if we do not use the concept of reverse trajectories. 


HI. NON-UNIQUENESS OF THE CORRECTION 
TERM 


The other correction term that has been obtained in 
is the following: 


I' = In 


p(yo\ x o)p(yi\ x i) ■ ■ ■p(yN\x N ) 


_p{yo\xi)p(yi\x 2 ) ■ ■ ■p{y N \x T ) 
To prove this, we proceed as before: 

0 -P(W-AF)-l' 


(14) 


f e -PH( 0 ) 

= J {dxi}{dyi} 
x p(yo\x 0 ) ■ ■ ■p(yN\x N ) 

Z(t) 

x P(yo\Xl) ■ ■ -p{yN\x T ) 

p(yo\x 0 ) ■ ■ -p(yN \xn) 


= / dxo{dy t }- 


= 1 . 


o-PH(t) 


-p(yo\xi) ■ ■ -p(yN\x T ) 


( 15 ) 


Here, we have used the normalization conditions 

J dyip(yi\x i+ 1 ) = 1 . 

We thus find that there can be more than one correction 
terms in the exponent. In fact, one can take a combina¬ 
tion of I and /' in different parts of the trajectory and 
still get the answer as unity (2311, which means that the 
number of possible corrections terms can be very large. 
At present it is not clear which one among them provides 
a better bound for the extracted work. 


IV. THE EFFICACY PARAMETER 
The efficacy paremeter is defined as 

7 = {e-^ w ~A F )y (16) 

Note that 7 = 1 if the Jarzynski equality (Eq. (|T]i) is 
satisified (i.e. in absence of feedback). However, if the 
protocol is feedback-controlled the RHS is in general dif¬ 
ferent from unity. We call this the efficacy parameter. 
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because if the work dissipated Wd = W - A F by the 
external agent is smaller, then it is larger. In this man¬ 
ner, 7 provides a measure of how efficient our feedback 
control is. For our system, we get 


the total entropy produced during the process. This is 
because the system is an isolated one, and it cannot dis¬ 
sipate any heat into its surroundings. One can then check 
that 


7 = 


f e ~pH( 0) 

j {dxi}{dyi} P {yi }{{xi}\x 0 ) 

x p(yo\xo)p(y±\xi) ■ ■ ■p(y N \x N ) 
.- 0 (h(t)~h(o)) m 


x e 


= / {dxi}{dyi} 


Z(t) 

e ~P H*(t) 


p iyn ({x*} |<) 


Z(r) 

x p{yo\x* 0 )p(yl\x\) ■ ■ -p{y* N \x* N ), 


(17) 


where asterisk (*) symbol implies time reversal opera¬ 
tion: x* = ( q,p )* = (q, ~p). We have used the re¬ 
sult P{ y .}({xi}\xo) = P{ y *y({x*}\x*), which means 
that the probability of tracing out a path {at,;} in phase 
space under protocol {A^ (f)} for given initial point Xq, 
is the same as that of tracing out a path {at*} for a 
given initial point x* and under the time-reversed pro¬ 
tocol {Ag 4 (r — t)}. We have further used the fact that 
the error probabilities are invariant under time-reversal: 
p(lli\ x i) — P{Vi\ x i)’ and the symmetry of Hamiltonian: 
H(t) = H*(t). Note that each x* can be mapped to x* 
through the relation a:* = M~\.(x*). Using the com¬ 
pact notation 


e -pH*(r) 

P*({ x *ih {Vl }) = z{t) P{y :} ({ x *}K) 

x p{yo\ x *o)p(yl\ x *i) ■ ■ -p{y* N \x* N ), 

(18) 

one then arrives at the relation 


7 = J {dyi}P*{{yi}). 


(19) 


The final expression is the total probability of obtaining 
time-reversed outcomes if measurements are performed 
on the time-reversed states. The efficacy parameter re¬ 
tains the same physical meaning irrespective of how the 
reverse process is generated. 


V. EXTENSION TO TOTAL ENTROPY 


Till now we have focussed on systems that begin in 
a state of thermal equilibrium. For a system beginning 
from an arbitrary initial distribution p(x o) and ending 
in the final distribution p(x T ), the change in system en¬ 
tropy is defined as As = \n.[p(xo)/p(x%)\ 01 il |U]. For 
a system undergoing Hamiltonian evolution, this itself is 


—As—I 


) = {dx i }{dy l }p(x 0 )P { y. } ({x i }\x 0 ) 


x p(yo\ x o)p(Vi\ x i) ■ ■ ■ p(Vn\ x n) 
P({yr}) 


p(K) 

p( x o) 


p(yo\ x o)p{yi\ x i) ■ ■ ■p(vn\ x n) 

= J {dx i }(dy i }p(aj;)P {H . } ({a:t}|*;)P({y i }) 
= I- (20) 


Once again, application of Jensen’s inequality gives 
(As) > — (I), which is the modified second law. 

We next derive the expression for the efficacy param¬ 
eter in this case, which is defined as 


7 = <e- As > 

= J {dx t }{dy l }p(x 0 )P {yi} ({x z }\x 0 )^^ 
x _p(yo|*o)p(yi|a;i) • • -p(yN\ x N) 

= J {dxj} {dy;}p(x*)P{y « } ({x*}|x}) 

x p{yo\ x o)p(y*\ x i) ■ ■ ■p(y*N\ x *N ) 

= J {dx i }{dy i }P*({x*},{y*}) 

= J{dy,}P*({ yi }). (21) 


Thus, we arrive at the same expression for the efficacy 
parameter that carries the same physical meaning, al¬ 
though our initial distribution is now considered to be 
arbitrary. 


VI. EXTENSION TO QUANTUM SYSTEMS 

For isolated quantum systems that undergo interme¬ 
diate projective measurements, the above formalism can 
easily be generalized, since the evolution is unitary in- 
between any two measurements [IS HH HI]- There is 
one-to-one correspondence between the initial and the fi¬ 
nal quantum states during this unitary evolution, which 
is a necessary requirement for the derivations carried out 
above. The derivations are similar to the ones for clas¬ 
sical Hamiltonian evolution, and therefore are not repro¬ 
duced here. Our final results remain the same. 
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VII. CONCLUSIONS 


We have shown that the extended fluctuation theorems 
for work and total entropy in presence of multiple mea¬ 
surements and feedback can be derived for a Hamiltonian 
system, by considering the forward phase space trajecto¬ 
ries only. The derivations are based on the fact that once 
the initial point is specified, the full trajectory gets speci¬ 
fied for such systems. On the contrary, in stochastic sys¬ 
tems, we must necessarily use the concept of reverse tra¬ 
jectories. We find that the correction term that appears in 


the exponent is not unique, but can be an arbitrary combi¬ 
nation of I and as elaborated in the text. To derive the 
final expression for the efficacy parameter, however, the 
notion of reverse trajectory must be considered. We find 
that this expression retains the same physical meaning, 
irrespective of how the reverse trajectory is generated. 
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